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BACKGROUND 



The present invention relates to processing objects in a computer graphics illustration 
application. 

f A computerWaphics illustration can be created using a computer graphics application 
program. The computer graphics illustration can include of several objects which in turn can 
be arranged in one or more layers. Each object is delimited by a border and has its own 
color. Intersections between objects located in different layers in the computer graphics 
illustration define atomic regies. 

-* The computer graphics illustration can be divided up into region that are independent 
of the objects and the atomic regions. A region can include a part of an object, or several 
objects, depending on thksize of the region. A region can further be tiled, that is, subdivided 
into portions (that is, tiles) that are independent of the objects or atomic regions within a 
given region of the computerWaphics illustration. A tile has a closed boundary and can have 
any geometrical shape or size. \ 

When printing an object in PostScript™ format from a graphics application such as 
Adobe® Illustrator, the PostScript™ printing process converts the received object data 
having a transparent imaging model and including several layers into a one-layer opaque 
model, using a technique known as planarization. The planarization technique includes steps 
for computing intersections between objects that are located in different layers in a computer 
graphics illustration to define atomic regions. Each atomic region includes a specific set of 
objects, each object having its own color. When all the atomic regions have been created, the 
atomic regions are processed one by one in order to create the final color of a given atomic 
region. 

In a conventional planarization process, objects in an atomic region have a vector- 
based representation. However, when an atomic region becomes too complicated, that is, 
when the atomic region contains a large number of objects, the planarization process divides 
the atomic region into tiles, and rasterizes each tile. In a rasterized tile, the resulting color of 
the tile is determined on a pixel-by-pixel basis, resulting in a raster-based representation for 
all objects that intersect the respective tile. 




Typically the planarization process does not flatten the raster-based representation 
forming a vector-based representation because stitching errors may occur. Normally, when a 
PostScript™ output is generated, each object has a vector-based representation and is painted 
in a particular order, the paint order. Stitching errors occur when the paint order is violated. 
5 Assume, for example, that there are two adjacent tiles. The first tile is processed and all the 
vector objects in the first tile are output. The second tile is processed and all the vector 
objects in the second tile are output. Since the tiles may share some pixels along the tile 
borders, some vector objects in the second tile may overwrite some vector objects in the first 
tile. This is a violation of the paint order. 
10 The right hand side of FIG. 1 shows the output result when no tiles are present and 

Q conventional PostScript™ rules are applied to a source image, shown in the left hand side of 

lv{ FIG. 1. A pixel grid (100) includes multiple individual pixels (105). Three objects are 

! ;0 drawn on the pixel grid (100). A light grey object (110) is drawn first, a dark grey object 

D 

„ll (1 1 5) is drawn second, and a black object (120) is drawn last. As can be seen, the borders of 

rh 

*i 15 all the objects fall between the lines of the pixel grid (100), that is, each object fully covers 

« some pixels and partially covers other pixels along its edges. 

□ 

rn The right hand side of FIG. 1 shows the output after the PostScript™ overscan rules 

have been applied to the source objects in the left hand side of the FIG. 1 . In summary, the 

II j 

p PostScript™ overscan rules require that when several objects occupy the same pixel, the 

|»k 

20 object that was drawn last will be drawn on top and occupy that entire pixel. As can be seen 
in the resulting output shown in the right hand side of FIG. 1, the light grey object (110) that 
was first drawn has been completely concealed by the dark grey object (115) and the black 
object (120). The resulting objects have also changed so that they completely occupy the 
pixels that previously were only partly occupied. 

25 FIG. 2 shows how a stitching error may arise when tiles are applied to the objects and 

the objects are processed as vector based data. The left hand side of FIG. 2 shows the same 
objects as are shown in the left hand side of FIG. 1, but with the addition of two tiles having 
borders that act as clipping paths. The objects within each tile or clipping path are processed 
independently of surrounding tiles or objects. The objects in the left hand side in FIG. 2 are 

30 painted in the following order: clipping path (125), light grey object (110), black object 
(120), clipping path (130), light grey object (110), and dark grey object (115). When the 
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PostScript™ output is generated, the objects inside the first clipping path (125) are processed 
first, and then the objects inside the second clipping path (130) are processed. When the light 
grey object inside the second clipping path (130) is processed, a row of pixels covering a part 
of the black object results, as shown on the right hand side in FIG. 2. This is an example of a 
5 violation of the paint order and results in a stitching error. 

SUMMARY 

In general, in one aspect, the invention provides methods and apparatus, including 
computer program products, implementing and using techniques for processing a computer 
graphics illustration, the computer graphics illustration having overlapping objects. Without 
^10 regard to the overlapping objects, at least a region of the computer graphics illustration is 
»i3 broken up into tiles having overlapping boundaries. The objects in each tile are planarized to 

r.o 

create flattened vector output representing the tiled region of the computer graphics 
!; r;f illustration. 

ts'ss 

i!R Advantageous implementations can include one or more of the following features. At 

7*15 least one of the overlapping objects can be transparent and the planarizing can include 

*«* converting the objects in each tile to an opaque flattened vector output representing the tiled 

Li region of the computer graphics illustration. Breaking up at least a region of the computer 

ri j 

graphics illustration into tiles having overlapping boundaries can include breaking up the 

leal 

computer graphics illustration into tiles having overlapping boundaries where tiles have the 
20 same shape or the same size. The tiles can be square shaped tiles with overlapping 
boundaries. 

Breaking up at least a region of the computer graphics illustration into tiles having 
overlapping boundaries can include breaking up the at least one region of the computer 
graphics illustration into a grid of adjacent, non-overlapping tiles and expanding the 
25 boundaries of one or more tiles in the grid in a direction such that the boundaries of the tiles 
overlap. The boundaries of one or more tiles in the tile grid can be expanded by at least one 
pixel in the horizontal or vertical direction. 

The size of the tiles can be selected based on an available amount of memory for 
planarizing the tiles. If the available amount of memory for planarizing the tiles will be 
30 exceeded, one or more of the overlapping tiles can be divided into smaller tiles with 



3 



overlapping boundaries. A determination can be implemented to predict if the available 
amount of memory for planarizing the tiles will be exceeded. Alternatively, a memory 
overflow condition during the planarizing of the objects in each tile can be monitored. The 
dividing step can be repeated until the size of each tile is such that the available amount of 
memory for planarizing each tile will not be exceeded. 

The size of the tiles can be selected based on the number of objects in a tile. If the 
number of objects in the tile exceeds a threshold value, one or more of the tiles with 
overlapping boundaries can be divided into smaller tiles with overlapping boundaries. The 
dividing step can be repeated until the size of each tile is such that the number of objects in 
each tile does not exceed the threshold value. Breaking up at least a region can include 
breaking up the computer graphics illustration. The border of each tile can be aligned to 
physical boundaries of pixels in a device space to make each tile include only pixels of the 
output device space that are wholly within the tile. 

In general, in one aspect, the invention provides methods and apparatus, including 
computer program products, implementing and using techniques for processing a computer 
graphics illustration having overlapping objects. Without regard to the overlapping objects, 
tiles having boundaries that overlap by an amount corresponding to at least one pixel in a 
device space are provided. The tiles cover at least a region of the computer graphics 
illustration that includes overlapping objects. A clipping path corresponding to the boundary 
of each tile is supplied, and the objects surrounded by each clipping path are processed to 
produce vector output. An alignment tool is defined that can be passed as a part of a stream 
to an output device. The alignment tool can instruct the output device to align each clipping 
path to physical boundaries of pixels in the output device space to make each tile include 
only pixels of the output device space that are wholly within the tile. 

Advantageous implementations can include one or more of the following features. 
The stream to the output device can be a Postscript™ stream. At least one of the overlapping 
objects can be transparent and processing can include converting the objects in each tile to an 
opaque flattened vector output representing the tiled region of the computer graphics 
illustration. The tiles can have the same shape or the same size. Providing tiles having 
overlapping boundaries can include providing a grid of adjacent, non-overlapping tiles and 




expanding the boundaries of one or more tiles in the grid in a horizontal or vertical direction 
such that the boundaries of the tiles overlap. 

In general, in one aspect, the invention provides methods and apparatus, including 
computer program products, implementing and using techniques for processing a computer 
5 graphics illustration, the computer graphics illustration having overlapping objects wherein at 
least one object is transparent. A region of the computer graphics illustration to be processed 
is selected. The region includes at least a portion of the transparent object. Without regard 
to the overlapping objects, a grid of overlapping tiles covering the selected region are 
created. A clipping path corresponding to the boundary of each tile is supplied. An 
10 alignment tool is defined and can be passed as a part of a stream to an output device is 
defined. The alignment tool can instruct the output device to align each clipping path to 
physical boundaries of pixels in the output device space to make each tile include only pixels 
|:J: s of the output device space that are wholly within the tile. The objects surrounded by each 

Q clipping path are processed to produce a vector output. The vector output and the alignment 

i;H 15 tool are passed in a stream to the output device. The alignment tool is used to align each tile 
^ to physical boundaries of pixels in the output device space to make each tile include only 

is 

□ pixels of the output device space that are wholly within the tile. The processed objects are 

fat 

\\ rendered as vector data on the output device. 

I y Advantageous implementations can include one or more of the following features. 

□ 

|«b 20 Creating a grid of overlapping tiles can include creating a grid of overlapping tiles in which 
adjacent tiles overlap by at least one pixel. At least one of the overlapping objects can be 
transparent and the processing can include converting the objects in each tile to an opaque 
flattened vector output representing the tiled region of the computer graphics illustration. 
In general, in one aspect, the invention provides methods and apparatus, including 

25 computer program products, implementing and using techniques for processing a computer 
graphics illustration, the computer graphics illustration having overlapping objects. 
Information is obtained about physical pixel boundaries in an output device space. Based on 
the pixel boundary information and, without regard to the overlapping objects, adjacent tiles 
covering at least a region of the computer graphics illustration that includes overlapping 

30 objects are provided. A clipping path corresponding to the boundary of each tile is supplied. 
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The objects surrounded by each clipping path are processed to produce a vector output and 
the vector output is passed as a stream to an output device. 

The invention can be implemented to realize one or more of the following 
advantages. By planarizing smaller overlapping tiles to create a vector output, the planarizer 
can bound its memory usage. Memory in output devices, such as printers, can also be used 
more efficiently since an image is processed in "chunks" rather than all at once. Furthermore, 
downstream processes following the planarization process will not be troubled by font 
mismatches, rendering mismatches or color conversion mismatches. Processes such as 
trapping can operate on the actual vector data and stitching problems can be avoided. Since 
the processes propose preserving object type information, such as image, line art or text, post 
processes can make object type specific decisions in PostScript™. Examples of such 
processes include: color conversion processes where image-type objects are processed with a 
different color conversion than non-image objects; processes where black text below a 
certain point threshold may be set to automatically overprint; processes where black text 
above a certain threshold may be converted into a "rich black" (that is, black in combination 
with another ink) and screening processes where some PostScript™ output devices recognize 
object types and assign different screens depending on the object type. 

The details of one or more embodiments of the invention are set forth in the 
accompanying drawings and the description below. Other features and advantages of the 
invention will become apparent from the description, the drawings, and the claims. 

DESCRIPTION OF DRAWINGS 

FIG. 1 shows a source image and a resulting output when PostScript™ is rendered 
from the source image in accordance with the prior art. 

FIG. 2 shows a tiled source image and a resulting output having a stitching error as a 
result of PostScript™ being rendered from the tiled source image in accordance with the 
prior art. 

FIG. 3A-3D show a source image, intermediate steps, and a resulting output when 
PostScript™ is rendered from the source image in accordance with one aspect of the 
invention. 




FIG. 4 shows a flowchart for processing a computer graphics illustration in 
accordance with one aspect of the invention. 

Like reference symbols in the various drawings indicate like elements. 



DETAILED DESCRIPTION 
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The invention will be described by way of example with reference to FIGs 3A-3D 
and FIG. 4. As shown in FIG. 4, a process (400) for processing a computer graphics 
illustration starts with the process receiving a user selection of the region of the computer 
graphics illustration to be processed (405). One example of a region of the computer 
graphics illustration to be processed is shown in FIG. 3A. The region includes the objects 
that were discussed above in connection with FIG. 1 and FIG. 2, that is, the region of the 
computer graphics illustration includes a light grey object (110), a black object (120) 
disposed on top of the light grey object, and a dark grey object (115) also disposed on top of 
the light grey object, but not overlapping the black object. 

The process then determines a tile size for the selected region of the computer 
graphics illustration (410). The tile size primarily depends on two factors: the available 
amount of memory for processing the contents of a tile and the complexity of each tile. For 
example, if a tile contains few objects or several objects with an opaque object at the top 
layer, then the tile size can be large since processing a tile with these characteristics will not 
require much memory. However, if a tile contains several objects, especially if one or more 
of the objects are transparent, more memory will be required. If the amount of memory 
needed exceeds the available amount, the tile size is decreased. Decreasing the tile size can 
be done either based on a prediction, or during processing of a tile if the memory should 
overflow. For example, a user, or the computer graphics application, can estimate an initial 
tile size. The estimation can, for example, be made by counting the number of objects or 
atomic regions within the region of the computer graphics illustration to be processed. The 
region is then subdivided into tiles having the initially determined tile size and the processing 
of the tiles is started. If a memory overflow condition occurs during the processing of the 
tiles, that is, if the initially chosen tile size is too big, each tile can be subdivided into two 
smaller tiles and the processing is restarted for each of the smaller tiles. If a memory 
overflow condition still occurs, each smaller tile is further subdivided, and the tile 
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determination process continues in this manner until an appropriate tile size has been 
determined. Another way of decreasing the tile size is to use the recursive Warnock's 
algorithm (see "Dirty Pixels" by Jim Blinn, Morgan Kauffman Publishers, 1998, pp 68-71). 

When an appropriate tile size has been determined, the process breaks up the selected 
region into overlapping tiles of the determined tile size. The object can be broken up into 
adjacent tiles (415), as shown in FIG. 3B (125, 130). The process then expands the borders 
of the tiles so that they overlap (420) and snaps the tiles to the pixel grid (422), as is shown 
by the dotted lines (135) in FIG. 3C. The size of the overlap can vary, but corresponds to at 
least one device pixel on the output device to which the graphics illustration will be sent after 
processing. For example, an ink-jet printer typically has a resolution of 300-600 dpi (dots 
per inch) and a laser printer typically has a resolution of 600-1200 dpi, so one device pixel 
would correspond to 1/1200 to 1/300 of an inch. Therefore, if the borders of the tiles are 
moved by 1/100 inch, for example, to expand the tile, this will expand the tile by more than 
one device pixel for any of the output devices in this example. 

The way the borders of a tile are moved when the tile is expanded to achieve an 
overlap is a matter of implementation. For example, if the tiles are square shaped, as shown 
in FIG. 3B and 3C, the border can be moved in one unit in a horizontal and one unit in a 
vertical direction for all the tiles. Alternatively, the border can be moved two units in a 
vertical and two units in a horizontal direction for every other tile. The tiles can be square 
shaped, triangular or hexagonal, and achieve the same results. 

After the overlapping tiles have been created, a clipping path is formed (425) along 
each tile's border. The clipping path is used for rendering the processed contents of each tile 
on an output device, as will be described below. 

The process continues by processing the objects inside each tile (430). In one 
implementation the processing of the objects includes a conventional planarization operation 
where the objects in the tile are combined into a single layer. Planarization is well known in 
the literature, and one example is described in the commonly owned U.S. Patent Application 
No. 09/444,778 to Bourdev et al. entitled "Processing Illustration Artwork," which is hereby 
incorporated by reference. The resulting output from the processing operation of each tile is 
a vector representation of the processed objects in the tile. 
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In one implementation, the vector representation of the processed content in each file 
can be sent to an output device as a PostScript™ stream. An exemplary PostScript™ 
algorithm for doing this can be found in Appendix A. The algorithm includes instructions for 
snapping the clipping path corresponding to each tile to the pixel grid on the actual output 
device (435) before the processed content of the tile is output (440). Snapping the clipping 
path includes reducing the size of the clipping path so that it only includes whole pixels on 
the output device. Any pixels on the output device that were only partially included in the 
clipping path are excluded when the clipping path is snapped to the pixel grid on the output 
device. Since the amount of overlap was selected to be at least one device pixel, all the 
clipping paths can be snapped to the pixel grid of the output device without risking missing 
any pixels. As a result, each pixel will be completely included inside at least one clipping 
path. 

Returning now to the selected objects in FIG. 3C, an exemplary output is shown in 
FIG. 3D when the borders of the overlapping tiles are used as clipping paths. First, the lower 
clipping path is snapped to the pixel grid of the output device and the objects inside the lower 
clipping path drawn (the part of the light grey object (110) that is included in the clipping 
path and the black object (120)). Second, the upper clipping path is snapped to the pixel grid 
of the output device, partly overlapping the lower clipping path, and the objects inside the 
lower clipping path are drawn (the part of the light grey object (110) that is included in the 
upper clipping path is drawn followed by the dark grey object (115)). Due to the overscan 
rules in PostScript™, the dark grey object will cover the whole clipping path, and the 
resulting output of the processed region is shown in FIG. 3D. As can be seen from FIG. 3D, 
the resulting output is identical to the output shown in FIG. 1, and stitching errors of the type 
shown in FIG. 2 have been avoided. 

Processing in accordance with the invention can be used in any context when the 
PostScript™ output is generated from a transparency aware application as long as some 
minimum final resolution can be assumed. 

By outputting the content of the tiles as vectors, the data will be more device- 
independent. For example, fonts can be used from the final output device and downstream 
processing, such as trapping, can operate on vector data, further avoiding rendering 
mismatches and color conversion mismatches. 
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The invention can be implemented in digital electronic circuitry, or in computer 
hardware, firmware, software, or in combinations of them. Apparatus of the invention can be 
implemented in a computer program product tangibly embodied in a machine-readable 
storage device for execution by a programmable processor; and method steps of the invention 
can be performed by a programmable processor executing a program of instructions to 
perform functions of the invention by operating on input data and generating output. The 
invention can be implemented advantageously in one or more computer programs that are 
executable on a programmable system including at least one programmable processor 
coupled to receive data and instructions from, and to transmit data and instructions to, a data 
storage system, at least one input device, and at least one output device. Each computer 
program can be implemented in a high-level procedural or object-oriented programming 
language, or in assembly or machine language if desired; and in any case, the language can 
be a compiled or interpreted language. Suitable processors include, by way of example, both 
general and special purpose microprocessors. Generally, a processor will receive instructions 
and data from a read-only memory and/or a random access memory. Generally, a computer 
will include one or more mass storage devices for storing data files; such devices include 
magnetic disks, such as internal hard disks and removable disks; magneto-optical disks; and 
optical disks. Storage devices suitable for tangibly embodying computer program 
instructions and data include all forms of non-volatile memory, including by way of example 
semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; 
magnetic disks such as internal hard disks and removable disks; magneto-optical disks; and 
CD-ROM disks. Any of the foregoing can be supplemented by, or incorporated in, ASICs 
(application-specific integrated circuits). 

To provide for interaction with a user, the invention can be implemented on a 
computer system having a display device such as a monitor or LCD screen for displaying 
information to the user and a keyboard and a pointing device such as a mouse or a trackball 
by which the user can provide input to the computer system. The computer system can be 
programmed to provide a graphical user interface through which computer programs interact 
with users. 

The invention has been described in terms of particular implementations. Other 
implementations are within the scope of the following claims. For example, the steps of the 
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invention can be performed in a different order and still achieve desirable results. The 
method can be used even when no transparent objects are present, for example, in order to 
subdivide a graphics illustration that is to be output on a printer and thereby allow the printer 
to use less internal memory. Furthermore, if the graphics application program has 
5 knowledge about the exact pixel size in the output device space, the tiles can be adjacent and 
do not need to overlap. The overlap can be avoided because the size and shape of the tiles 
can be chosen to conform exactly to the pixel boundaries in the output device space. 

The processing method described in this application can also be use in combination 
with conventional raster based tiling processes, where the novel process described in this 
10 application and conventional processes can be applied to different regions of a computer 
graphics illustration. 

What is claimed is 
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